Horseshoe Chaos in a 3D Neural Network with Different Activation Functions
نویسندگان
چکیده
This paper studies a small neural network with three neurons. First, the activation function takes the sign function. Although the network is a simple hybrid systemwith all subsystems being exponentially stable, we find that it can exhibit very complex dynamics such as limit cycles and chaos. Since the sign function is a limit case of sigmoidal functions, we find that chaos robustly exists with some different activation functions, which implies that such chaos in this network is more related to its weight matrix than the type of activation functions. For chaos, we present a rigorous computer-assisted study by virtue of topological horseshoe theory.
منابع مشابه
Delineation of Alteration Zones Based on Wavelet Neural Network (WNN) and Concentration–Volume (C-V) Fractal Methods in the Hypogene Zone of Porphyry Copper Deposit, Shahr-e-Babak District, SE Iran
In this paper, we aim to achieve two specific objectives. The first one is to examine the applicability of wavelet neural network (WNN) technique in ore grade estimation, which is based on integration between wavelet theory and Artificial Neural Network (ANN). Different wavelets are applied as activation functions to estimate Cu grade of borehole data in the hypogene zone of porphyry ore deposi...
متن کاملDesign and Simulation of Adaptive Neuro Fuzzy Inference Based Controller for Chaotic Lorenz System
Chaos is a nonlinear behavior that shows chaotic and irregular responses to internal and external stimuli in dynamic systems. This behavior usually appears in systems that are highly sensitive to initial condition. In these systems, stabilization is a highly considerable tool for eliminating aberrant behaviors. In this paper, the problem of stabilization and tracking the chaos are investigated....
متن کاملAN IMPROVED CONTROLLED CHAOTIC NEURAL NETWORK FOR PATTERN RECOGNITION
A sigmoid function is necessary for creation a chaotic neural network (CNN). In this paper, a new function for CNN is proposed that it can increase the speed of convergence. In the proposed method, we use a novel signal for controlling chaos. Both the theory analysis and computer simulation results show that the performance of CNN can be improved remarkably by using our method. By means of this...
متن کاملAnalysis and Diagnosis of Partial Discharge of Power Capacitors Using Extension Neural Network Algorithm and Synchronous Detection Based Chaos Theory
Power capacitors are important equipment of the power systems that are being operated in high voltage levels at high temperatures for long periods. As time goes on, their insulation fracture rate increases, and partial discharge is the most important cause of their fracture. Therefore, fast and accurate methods have great importance to accurately diagnosis the partial discharge. Conventional me...
متن کاملHybrid Control to Approach Chaos Synchronization of Uncertain DUFFING Oscillator Systems with External Disturbance
This paper proposes a hybrid control scheme for the synchronization of two chaotic Duffing oscillator system, subject to uncertainties and external disturbances. The novelty of this scheme is that the Linear Quadratic Regulation (LQR) control, Sliding Mode (SM) control and Gaussian Radial basis Function Neural Network (GRBFNN) control are combined to chaos synchronization with respect to extern...
متن کامل